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me  prcbieni  cf  ineciijuiiii'j  the  ^ualit}  health  care  oue 
ci  the  Hiott  t.vabive,  yet  iinpottant,  to nxeir.s  xn  medical 
damip-ist  xa  ti  cXi .  CutcoDic  mecsiixee,  x.tat;uret;  or  the  aedxjc-.i 
decision  process,  and  measures  or  the  t/iiysicax  or 
autiristra  tive  structure  of  an  c>ruani^ation ,  tht  three  rrajoi 
afprodches  to  quality  measurement,  aii  cutter  from  various 
drawxiacho.  Multiattribute  utility  (MAU)  analysis  car 
potentially  resolve  many  of  tne  issues  involved  in  'aOality 
assurance.  In  this  paper  the  potential  contributions  cf  MAU 
analysis  are  outlined,  a  number  or  MAU  studies  contrihutinc 
to  quality  measurewent  discussed,  and  suqqestionu  tor 
juality  assurance  systems  made. 
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to  develop  a  useiux  lueasuc^  ot  me  juaiaty  or 
medic.il  care  has  becoiue  iiicree.ainyiy  jm[.cetai;t  iti  r^rcti-t 
ycat'J^.  A  nucioer  or  reae-ons  ior  this  neea  caa  be  cirri, 
inciujifiy  thi=  ntc.ssiry  oi  dote.,  mi  r.*ii  j  r  ic  yuality  of;  care 
deiivored  by  iiinc-vativ^i  ineiicai  Gate  ojstcao,  tae  iiic reaped 
interest  in  and  use  of  paramedical  pioiessionais  in 
aeliveriay  care,  tae  need  to  control  u,edicdi  costs  wimour 
sacEiciciag  guaJity,  the  iucreasing  role  of  thira  parties  iji 
paying  tne-  costs  or  weaical  care,  and  the  neea  to  certify 
institutions  engaged  in  medical  care  delivery.  Ine  .  prooieu 
or  hew  to  measure  quality  oi  care,  however,  is  an  elusive 
one.  guality  meas  ur  euieii  t  requires  one  to  ccitt-are  rpultipic 
etfectiveress  criteria,  to  dc  so  consistently ,  and  to  do  so 
ill  an  uncertain,  complex  en  viornreent .  These  considerations 
suggest  the  potential  useralness  of  mult iattriLu te  utility 
(MAu)  analysis  in  deriving  .quality  standarco.  Eefore 

discussing  ticaliy  the  manner  ir.  wnich  EA 1  analysis 

cculd  centritute  to  this  area,  a  nrief  summar/  of  the 
capacities  cf  MAC  analysis  is  given,  then  some  cf  me 
problems  involved  in  deiining  and  measuring  quality  cf  care 
are  discussed.  Tne  potential  rol^i  of  .iAU  analysis  ir. 
attagl'^ing  seme  cf  these  issues  is  indicated.  Finally,  a 
suggested  quality  measurement  system  is  outlined. 


1.  iumniaiy  of  MAU  Analysis 

The  tern  MaU  Analysis,  as  used  in  this  [.aper,  lofers  to 
me  normative  system  of  decision  anal/sis  as  expounded  in  a 
aUffloer  of  sources,  among  them  Raiifc.^,  Noith*",  .>chlaifeiJ, 
aiil  drown  et  »  together.  with  me  results  of 

inultiattribute  utility  theory  as  discussed  by  Keen  ^  y  ^  ,  o  ,  7  ^  a  ^ 
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r  is  niiarn  9  j  i  0  ^  1 1  ^  fistiburu  and  Keenciy*^^  arcj  F  ary  u  hai/*  ^  , 
amcng  othei-s.  In  essence,  multiattribute  utility  theuretic 
results  allow  one,  given  certain  a ssuni p cions  ccncerning 
one's  utility  structure,  to  develop  and  express  a  utility 
function  over  jDultiple  attributes.  inis  results  in  the 
developfiient  of  a  singxe  measure  of  "goodness"  whicn 
summarizes  multirie,  possioiy  conflicting,  measures. 
Furtnur,  as  ricst  indicated  by  Von  iveumann  and 
dcrgenster a* the  expected  value  of  such  a  utility  function 
caio  oe  used  as  a  decision  criterion  under  uncertainty. 
Docisron  analytic  tacnnigues  then  ix^dicate  how  even  ccmpLco: 
decision  problems  can  be  structured  and  analyzed,  using  a 
utility  function  to  guide  the  analysis.  Final  results  can 
include  xiqt  only  optimal  decision  strategies,  but  such  data 
as  the  value  of  additional  information  and  the  sensitivity 
or  results  tc  analytical  inputs. 


II.  Defining  and  Measuring  Quality  of  Medical  Care 

'with  this  preliminary  summary  of  the  analytic  tools 
completed,  let  us  turn  to  txie  problem  at  hand,  measuring  the 
guality  cf  medical  care.  Defining  "guaiity  of  medical  care" 
is  itself  a  task  cf  remarkable  difficulty.  Donabediau‘5 
points  cut  that  in  practice  guaiity  can  be  almost  anytning 
anyone  wishes  it  tc  oe,  thus  any  discussion  of  tae  subject 
IS  potentially  plagued  with  misunderstanding.  "Quality  of 
care"  is  clearly  not  a  unitary  concept  but  a  composite  of 
many,  sometimes  conflicting,  desiderata  whicii  must  be 
siffultaneously  considered.  There  is  agreement  on  some  of 

the  ractors  that  go  into  quality  -  success  of  the  care  in 

prtsepving  or  restcrpng  health,  efficiency  in  the  use  of 
resources,  prevention  and  alleviation  cf  physical  and 

psychological  surrering  -  but  there  is  wide  disagreement 

on  how  inclusive  such  a  list  of  factors  should  be  and  hov/ 
much  emphasis  is  due  each  of  the  aspects.  k’e  might  examine 


this  issue  Ly  consid  er  j.ri'j  first  uiea  suro-'S  or  quality  ot  cire 
foi  au  individual,  then  discussing  the  issues  involved  in 
extending  these  conce[jts  to  groups  or  societies. 


Quality  Haasurement  lor  Individuals 

for  an  individual  the  delivery  ot  c:auicai  care  can  oe 
tfcougiit  Cl  as  afiacting,  in  a  probabilistic  sense,  me 
healtii,  i-sycbolcgicdi,  ana  finaaciai  outcomes  exper rep.ce J  ny 
the  persen.  A  number  ox  these  outcomes  are  guantiriabie, 
sucii  as  morbidity,  mortality,  amount  or  money  expended  on 
ncaith-r  sia  t  €d  items,  freedom  from  pain  and  discoialort,  even 
degree  ot  freedem  from  ps ychoiogica 1  stress.  for 
indiviiudls  then,  the  ultimate  validators  of  quality  exist 
in  more  or  less  accessible  form,  altnougn  in  emoarr assing 
richness,  l*hen  trying  to  use  outcomes  to  measure  quality 
one  must  resolve  a  number  of  issues.  Fir,>t,  w.iich  outcome 
measures  are  to  be  used,  and  how  are  they  to  be  combined? 
In  treating  p'atients  with  certain  chronic  disabilities,  for 
example,  treatment  strategies  can  depend  strengiy  on  wnether 
one  considers  morbitity  or  mortality  of  primary  importance. 
Second,  even  ix  one  succeeds  in  devising  a  satisfactory 
unitary  measure,  the  uncertainty  and  complexity  of  medical 
processes  make  it  difficult  to  determine  an  optimal  strategy 
for  delivering  care.  Third,  even  ir  an  optimal  strategy 
were  available,  the  diagnostic  skills,  treatment  skills, 
patient  management  sKills,  even  the  mechanical  SKiiis  (s.g. 
now  quickly  and  easily  can  a  iiypodermic  needle  be  inserted) 
of  the  medical  practitioners  involved  in  the  delivery  system 
can  have  a  great  iinp)act  on  the  outcomes.  Thus,  a  standard 
ct  comparisen  is  required  against  wbicli  actual  outcomes  can 
be  measured.  Ideally  the  standard  would  be  quantitative, 
would  control  ror  the  preexisting  coiiJition  of  the  patient, 
and  would  allow  for  the  inherent  uncertainty  i;\  any  medical 
intervention.  A  final  proolem  witli  any  quality  control 


3 


system  which  deoeuds  on  outcome  measures  is  tlie  time  dt-lay 
often  required  for  some  outcomes  to  become  manifest.  The 
success  cf  souie  treatments  is  not  fully  known  until  years 
have  passed . 

.'iAU  analysis  ctfers  the  capacity  of  deaiinj  with  some 
of  these  issues.  The  issue  of  determining  which  cutcome 
raeasui-es  are  to  be  used  and  the  way  in  wnich  they  are  to  he 
comoined  can  be  resolvea  by  assessing  a  utility  function 
over  those  outcome  measures  the  person  considers  relevant. 
The  practicality  of  this  approach  has  been  demonstrated  in  a 
number  ‘  of  studies.  Giauque  and  Peribles^^,  in  analyzang 
streptococcal  sore  throat  and  rheumatic  fever,  assessed  a 
utility  function  ever  ten  measures,  including  cost  factors, 
the  number  of  days  ill  with  streptococcal  infection, 
severity  of  antibiotic  reactions  if  any,  and  the  existence 
and  severity  of  acute  rheumatic  fever  and  chronic  rheumatic 
heart  disease.  Ktischer^^,  in  analyzing  patient  management 
decisions  ter  clert  palate,  assessed  utility  functions  ever 
suen  "ncnquantifiable"  factors  as  tlie  degree  ox  speecn  and 
nearing  iiipeuiment  and  the  degree  of  disf igurement  remaining 
after  treatment,  as  well  as  the  cost  cf  the  treatment. 
Kai-ernicki®  assessed  a  utility  function  over  costs,  various 
degrees  of  illness  and  inconvenience,  reduction  in 
longevity,  and  the  possibility  of  death  in  analyzing 
hypertension.  Ginsberg  and  Offensend^'^  assess  utilities  in 
analyzing  a  particular  case  of  back  pain,  although  they 
determine  utilities  directly  for  a  limited  number  of 
outcomes  rather  than  specifically  assessing  a  multiattribute 
utility  function.  This  approach  is  somewhat  simpler  tnan 
the  multiattribute  approach,  nut  is  limited  in  that  only  a 
small  number  cf  specific  outcomes  can  ne  considered. 

A  potential  pronlem  which  is  not  totally  resolved  by 
I'iAU  techniques  is  that  of  whose  utility  lunction  should 
guide  the  treatment  of  a  patient.  Clearly  the  patient 
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nimself  sttculd  be  the  priiT'dry  choice,  cut  c)jere  ire 
situations  where  a  patient's  preferences  may  need  to  bo 
surorainated  to  an  overaxl  societal  need,  for  examf^e  in 
iraposiuq  a  i^uarantine.  Inis  issue  may  be  cr  wore 
theoretical  than  practical  importance  if  ail  peisons 
involved  have  utility  structures  iaplyinq  identical  courses 
of  action.  In  the  studies  by  Giaujue  and  Peebles*^  and 
Ktiscnsr^^  tnis  was  indeed  the  case.  Giaur,ue  and  Peebles 
retorted  that  utilities  assessed  trom  patients,  doctors, 
nurse  practitioners,  and  public  health  officials  varied  trow 
individual  tc  individual  but  not  ii.  any  systemirtic  way  front 
group  tc  grcrp,  and  that  lu  any  case  the  solution  was  ao 
robust  as  to  give  identical  optimal  strategies  for  each 
assessor.  Krischer  reported  that  the  utilities  assessed  by 
ail  respcndants  to  a  guestionnaire  were  very  close  tc  <=ach 
other.  Hcwever  oiiC  cannot  always  count  on  results  being 
tnis  tortuitous.  In  case  of  conflicting  strategies,  one 
solution  would  be  to  choose  that  which  maximizes  the  group 
utility  of  the  entire  society.  In  the  case  of  quarantine, 
for  example,  the  disutility  of  the  quarantine  f pr  the 
individual  irust  be  compared  to  the  utility  of  disease 
dvcidance  by  the  remaining  population.  This  general  issue 
is  discuosed  furthur  in  the  next  section  of  this  paper. 

The  prctlem  of  determining  optimal  strategies  for 
delivering  care  can  also  be  attacked  through  KAU  Analysis. 
Lacn  of  Che  studies  cited  above  was  decision  oriented,  in 
that  the  optimal  strategies  for  administering  diagnostic  and 
treatment  prccedures  were  determined.  A  number  of 
additional  decisicn  analytic  studies  of  n^edicai  picblems 
could  also  be  cited.  Ginsbarg^<^  analyzed  the 
pleural- effusion  syndrome ,  expounding  in  addition  a  general 
analytic  framework  for  medical  analysis.  Lusted^i, 
Jdcguez22,  Gcrry^-*,?^,  and  Gorry  and  Barnett-^s  discuss 
diagnostic  approaches  utiiiziitg  concep^ts  of  decision  theory, 
wtiiie  betague  and  Gorry^^,  Schwartz  et  ai^?^  Gorry  et 
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discuss  additional  concepts  in  medical  decisioti 
analysis.  Krischer*^  (Section  1.2)  contains  a  useful 
summary  of  many  of  these  papers.  Giaa:jue29  contains  a 
summary  of  decision  analytic  studies  in  non-medical,  as  well 
as  medical  areas.  Thus  the  feasibility  of  using  decision 
analytic  techniques  to  structure  and  resolve  complex, 
uncertain  problems  has  been  demonstrated,  but  cnere  remains 
the  issue  ci  practicality,  deter niiniijg  whether  an  analysis 
is  worth  the'  ret  i neon seguen tial  time  and  ticucle  it  takes 
to  carry  it  cut.  Often  the  analysis  would  net  be  worthwhile 
for  a  single’ individual,  but  may  be  justified  if  the  results 
could  be  applied  to  entire  groups  of  patients.  Kost  cf  the 
studies  cited  above  were  indeed  intended  to  apply  tc  nicst  or 
all  patients  falling  within  certain  classes.  In  some  cf  the 
studies  an  attempt  was  made  to  identity  those  patient 
characteristics  which  would  affect  the  derived  optimal 
strategy.  Giaugue  and  Peebles^^  for  example  examined  the 
effects  cf  patient  age,  days  since  onset  of  the  sy mptcaiatic 
streptococcal  infection,  and  prior  history  of  penicillin 
reactions.  KapernicRi®  controlled  for  patient  age  and 
general  patient  health.  Such  stuuies  can  be  considered 
preiiairiaiy  attempts  to  establish  decision  standards  which 
ace  ccnticlled  fer  the  preexisting  conditicn  of  the  patient, 
but  clearly  a  good  deal  more  needs  to  ba  done  before 
definitive  standards  can  be  said  to  exist. 

'  The  third  issue,  estaolishing  outcome  standards  to 
control  for  practitioner  skill,  cannot  be  done  cn  an 
individual  patient  basis  due  to  the  stochastic  nature  ci  the 
medical  process.  Just  as  good  decisions  do  not  guarantee 
goed  outcomes,  so  good  procedures  administered  with  the 
utmesr  skill,  even  when  combined  witn  good  decisions,  cannot 
guarantea  good  outcomes.  The  yiAU  Analytic  techniques 
discussed  abeve  do,  nowever,  establish  average  occurrence 
rates  foi  various  outcomes.  These  data  could  potentially  be 
used  as  a  basis  for  a  control  system,  but  this  would  have  to 
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bt  over  many  patients,  rather  than  for  an  inaividuai  caft. 
lu  audition,  the  oftiraal  strategies  can  themselves  serve  as 
standaras,  but  as  t'^ocess  standarus  rather  taan  outcon'^ 
standards.  frocess  ineasureinent  orters  a  number  o£ 
advantages  ever  cutcooie  measurereent .  first,  results  of 
frccess  measurement  are  available  relatively  scon, 
iti'irediat  fcly  following  the  care  delivery  if  necessary. 
Secend,  fiocess  measurement  attempts  to  directly  assess  the 
guality  cr  the  decisions  made,  thus  allowing  one  a  standard 
wnicn  dees  not  involve  uncertainty.  ihe  uncertainty 
regarding  outcomes  is  automatically  accounted  for  in  setting 
the  standard.  finally,  many  process  measurements  are 
concrete,  either  in  terms  of  whether  cr  not  a  t/articuar 
service  was  performed  in  an  individual  case,  cr  in  terms  of 
s'tatistical  measures,  such  as  the  proportion  of  the 
population  rtached,  the  volume  of  services  rendered,  and  the 
costs  or  service.  Kany  suggested  guality  control  technijues 
are  ouiit  arcund  process  measures.  Forst^o  suggests  using 
process  standards  constructed  by  MAU  analysis  in  determining 
settlements  in  malpractice  suits.  Flaglesi  suggests  nine 
measures  ct  process  of  care,  covering  the  areas  of 
inclusiveness,  adeguacy  of  content,  and  proa uc t i vir y . 
Dcndbedian^?  contains  an  extensive  discussion  oi  tnc  issues 
involved  in  process  measurement,  many  or  which  relate  to  the 
practicality  cf  a  measaremen  t  system  for  large  groups.  Tiiis 
leaas  us  intc  a  consideration  of  issues  involved  in  guaiity 
measurement  tex  groups  and  societies. 


Quality  Measurement  for  Groups 


Suppose  we  have  successfully 
and  determined  optimal  treatment 
or  a  p'articular  group,  and  we  are 
wnich  may  artect  all  momoers 
concerning  care  can  still  ne  male 


assessed  utilities  from 
strategies  for  each  member 
now  faced  witn  decisions 
or  the  group.  decisions 
for  eacn  meaiLer  of  the 
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grcup  individually,  but  those  individual  decisicns  are 
ccnstrainea  by,  and  in  some  cases  guided  oy,  group 
decisions.  Ihe  design  or  the  delivery  system,  tor  example. 
Can  limit  access  to  even  basic  medical  care  by  some  traits  of 
the  populaticn.  A  societal  decision  to  extend  tne 
availability  ci  uasic  care  throagn  say  a  system  or  low  cost 
neighborhooa  clingcs  niignt  result  in  better  care  fer  some 
people,  but  cne  might  iegitiraately  ask  wnetner  this  would 
result  in  higher  overall  gaality  than  building,  tor  example, 
a  dialysis  unit  for  those  with  kidney  disease.  In  either 
case  the  failure  of  the  group,  to  provide  certain  resources 
may  effectively  limit  the  options  open  to  the  individuals. 
We  are  new  faced  with  the  problem  of  determining  a  so-called 
social  welfare  function,  a  measure  wnich  summari2e£  the 
welfare,  or  utility,  of  the  group  as  a  whole.  If  sacn  a 
function  could  ne  found  then  our  choice  of  group  action 
could  be  guided  by  it^  but  there  are  some  difficult 
tneoretic  and  t-j^dctical  proolems  involved.  Kirkwood^a  chap. 
II  contains  a  summary  of  these  issues.  Briefly,  it  is 
possiule  tc  define  a  social  welfare  function,  given  the 
utilitie.s  fer  each  member  of  the  group,  but  only  it  some 
restrictions  are  met.  i?erhaps  the  most  convenient  form  is 
that  given  by  Harsanyi^^,  which  gives  tne  group  utility  of 
any  alternative  as  the  weighted  sum  of  the  utilities  of  each 
individual  fer  the  alternative.  Required  conditions  are 
that  both  the  group  utility  and  tne  individual  utilities 
obey  the  ven  Neumann  -  Morgen.stern  axioms  of  cardinal 
utility  cr  their  oguxvaient,  and  that  if  twe  situations  are 
indifferent  frero  the  standpoint  of  all  individuals,  then 
tney  are  indifferent  for  the  group  as  a  whole.  Kirkwood-^'^ 
generalizes  these  results  by  applying  the  concepts  of 
pairwise  preferential  indepexidence  and  mutual  utility 
independence,  as  discussed  in  Keeney ^ ,  ft ,  7 ^ a ^  tc  group 
utility  structures.  The  more  general  formulations  developed 
by  Kirkwcod  also  construct  the  group  utility  function  by 
multiplyirg  tne  individual  utilities  oy  weighting  censtants, 
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then  aading  and/cr  multiplying  the  weighted  utilitiai. 
Assuming  these  iormuldtions  give  reasonable  a,.proxirraticns 
in  real  conditions,  one  must  only  assign  weights  tc  =acn 
inoividuii,  in  efiect  determining  whose  prererences  shciid 
count  tne  nest,  to  get  the  jroap  utility  xunccion.  Jiving 
eacn  person  in  the  group  an  eguai  weignt  is  one  otvious 
possibility,  althougn  this  raises  some  interesting  gue^tions 
(should  iacie  weight  be  given  to  those  wno  give  tne  gLeateot 
rinancidi  support  to  the  system,  snouid  <ige  or  genciil 
heaitii  aifect  weights,  how  should  preleiences  or  person  5  *:;o 
deliver  the  care  be  accounted  for,  etc,)* 

oiven  the  possibilities  or  this  methodology  in 
determining  optimal  strategies  for  the  group,  tne  practical 
pccnleio  tecains  of  how  to  set  up  a  _,uaiity  control  system 
whicn  exploits  them.  As  in  tne  case  of  indiviaiai  guality 
control  the  outcomes  experienced  by  tne  group  can  re  isea  to 
measure  the  overall  effectiveness  of  a  system,  witn  the 
signiticant  aavantage  that  uncertainty,  in  a  large  sample, 
can  re  at  least  partially  accounted  for.  Average  occurrence 
rates,  uetermined  ay  the  optimal  strategies  cnoseii,  can 
serve  as  gtality  standards.  However,  the  other  major 
difficulty  with  outcome  measures,  the  time  delay  often 
occurring  netween  treatment  and  the  final  observation  of  all 
cutcomes,  si. '.11  remains.  dven  if  ti.e  delay  is  not  excessive 
there  are  iormidable  problems  in  garnering  aata  cn  aii 
pertinent  outcomes,  especially  once  the  patieiit  leaves  t  .ne 
site.  Ke  can,  though,  use  process  standards  to  letecinine 
the  quality  at  least  of  the  decision  making,  though  perhaps 
not  Che  skill  of  the  practitioners  in  performing  tne 
pr c ce SS8 s , 

Donated ian^ 2 ^  in  ^xs  extensive  discussion  of  process 
standards,  points  cut  that  it  we  attempt  to  define  scandarls 
tor  every  pcssinle  situation,  even  allowing  the  possihiiity 
of  setting  meaningful  standards,  we  would  become  hopelessly 
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bogged  Jown  in  endless  detail.  Clearly  we  cannot  hope  to 
predefine  optimal  actions  for  each  possible  prcblein  for  each 
possinle  patient.  However,  we  can  determine,  for  those 
medical  prcfclenis  which  are  important,  where  uncertainty 
exists  ccDcerning  which  among  signif icantiy  dirrerent 
courses  cf  action  is  nest,  the  relative  desirabi Lities  of 
different  strategies,  and  determine  tne  sensitivity  of  the 
choice  of  strategy  to  patient  cnaracteristics.  Inns, 
critical  factors  are  identiried,  allowing  tne  practitioner 
to  locus  his  attention  and  use  his  judgment  on  relative  well 
defined  issues.  In  addition,  retrospective  analysis  can  ue 
used  for  gudlity  control  after  the  fact,  either  in  medical 
audits  or  in  lawsuits,  as  suggested  by  Forst^o. 

i'us  m c c ti a n ic a  1  and  adminrstratj./e  probj.ct<is  or  u*:foignaog 
an  cngcing,  systematic  yua^ity  esjies.sment  program 
formidable.  Supposing  that  outcome  and/or  process  standards 
exist  fcr  at  least  somt;  areas,  how  are  the  data  measuring 
actual  outccices  and  processes  to  be  collected?  Overall 

statistics  cr  some  outcome  measures,  such  as  mortality,  are 
sonetimes  available,  but  data  cn  other  measures  may  be 
ccmpletely  lacking.  Patient  records  are  generally  sketcny, 
incomplete,  and  difficult  to  access.  kecolieccions  of 
patients  and  practitioners  are  subject  to  oias, 
inaccuracies,  and  incompleteness,  while  medical 

practiticners ,  particularly  physicians,  are  ioth  to  te  too 
critical  of  colleagues.  I’he  mechanisms  for  conducting 
process  reviews  also  lead  to  problems.  Case  reviews  are 
expensive  and  suffer  from  the  lack  of  good  source  data. 
Direct  observation  of  a  practitioner's  activities  is  axso 
exp<-nsive  and  is  apt  to  change  the  practit ioner '  s  behavior. 
In  addition,  the  observer  may  not  know  as  much  as  the 
practitioner  in  sotte  areas,  particularly  concerning  patient 
histories,  thus  possibly  leading  to  inaccurate  jiidgoents. 
Statistical  indices,  are  easy  to  review,  but  may  be 
difficult  tc  collect,  to  identify  with  a  particular  system 
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or.  Cai-O,  and  to  cchtirol  £ol'  aatic:nt  clia  i.  ac  tcj.  i  ot  i  cs .  Tor 
thtso  Etascns,  structural  measures  usuall}  supjju.eiii.,nt 
outcome  measures  and  process  measures  in  «juality  assess.ueit. 

otiui.tute  measures  examine  the  physical,  t-ro  f  essiona  1, 
and  Operational  structures  of  i  ist  itut  ior.s  in  •'nica  ’ll-,  jicij. 
care  taxes  ^lact  .  As  defined  oy  Iiona  t- ec  ia  n  ‘  ^  ,  strtct.j.^e 
measures  are  ''concerned  with  such  things  as  the  adequacy  o; 
lacilities  and  equipment,  tne  guaiir ica tions  of  medical 
staff  and  their  organization;  tne  administrative  structure 
and  operatiens  of  programs  and  institutions  providing  care; 
fiscal  organization  and  the  like."  Structure  measures  can 
re  relative  easily  and  cheaply  made,  and  tne  results  =ire 
available  quickly.  In  additioij,  they  are  rainy  ccncm*=', 
at  least  in  part,  thus  are  mor'^  amenarle  tc  control  tneougn 
guidelines  and  legislation  than  otaer  measures.  The  major 
drawback  of  structure  meaivures  is  tne  rather  tenuous 
ccnnecticn  between  structure  and  outcome.  There  are  some 
instances  where  a  connection  can  be  drawn;  if  certain 
processes  car  be  identified  as  desirable  in  treating  a  given 
disease  and  if  tliose  processes  require  certain  types  of 
training  cr  eguipment,  then  clearly  the  presence  cf  that 
equipment  cx  cf  adequately  trained  personnel  is  a  necessary, 
though  net  sufficient,  conuition  to  yooc  ^^uality  care.  Even 
in  this  case,  however,  tne  actual  delivery  or  hign  ^uality 
care  is  not  assured.  In  more  general  situations,  there  can 
be  significant  differences  cf  opinion  concerning  tne 
centr iou tions  cf  various  structural  measures  to  tne  gulaity 
of  care. 


13  I  . 


Sujcested  Quality  Control  Systors 


The  setting  in  which  meaical  care  is  being  delivered 
has  a  great  impact  on  tne  feasiblt;  raecliariisms  rot 
adn mistering  a  guality  control  system.  In  this  section  we 
will  discuss  three  types  or  setting,  a  large  ccncroired 
group,  a  soall  informal  group  or  private  practice,  and 
guasi-raedical  institutions.  There  are,  or  course,  other 
j.  ossioilities ,  out  these  tnree  will  surface  to  iilurlrate 
the  major  issues. 


barge  Controlled  Groups 

A  large  ccntrollcd  group  is  typiiied  by  many  military 
health  care  crgani  za  txon a -s  well,  as  by  some  large  civilian 
group  or  public  health  practices.  The  major  characteristic 
of  such  groups  is  the  existence  of  a  recognized  authority  or 
chain  cf  authority  in  administrative  matters,  and  at  least 
to  some  extent  in  medical  matters.  Sucn  organizations  serve 
sizable  populations  and  asually,  though  not  always, 
individual  relationships  between  tne  patit-nt  and  the  health 
practiticrer  are  not  strong.  This  creates  a  need  (not 
always  fulfilled)  for  a  good  patient  record  system,  while 
the  e.xistence  of  the  central  authority  provides  the  means  to 
design  and  inplement  such  a  system,  Furtnur,  the  size  of 
such  groups  makes  innovative  methods  of  health  care  delivery 
bctn  possiole  and  important.,  and  the  need  to  evaluate  the 
resulting  gualiry  Os  care  is  esp'eciaiiy  acute.  For  such 
sett.lng.s,  sepa-rate  levels  of  guality  control  based  on 
outcome  measures,  process  measures,  and  structure  measures 
are  suggested.  First,  outcome  data  can  oe  collected  through 
the  patient  record  system.  To  minimize  the  difficulties 
caused  by  the  time  lag  between  treatment  and  the  observation 
cf  cutccmes,  "indicator"  presenting  symptom  complexes  could 
be  selected  and  statistics  on  the  outcomes  for  patients  with 
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triost  ptesentiug  symptoms  gathered.  The  indicacOi.  sy..i..t:om 
ccttplexes  shcuid  be  such  that  outcomes  could  f<e  obscivt^d 
within  a  faitly  short  time,  and  shoula  ae  ccoimon  enougn  to 
allow  reasonable  sample  sizes  for  each  pr act r t lo net .  Tne 
term  "syaptcm  complex",  incidently,  is  used  in  place  or 
"disease"  since  the  patient  presents  a  complex  of  syirftoms 
to  tne  aedical  system,  ana  determining  tne  cause  cl  z.ie 
syaptoms,  the  disease,  is  part  of  the  aiagncstic  prchljm. 
Scire  possitie  symptom  complexes  are^s  heaaache,  lowei  rack 
pain,  cc ns tipa tio r ,  and  obesity.  For  each  symptom  complex 
chosen,  MAD  analysis  could  be  used  to  determine  which 
diagnostic/tieatme nt  processes  are  optimal,  to  examine  the 
effects  of  patient  characteristics  upon  Oj-tiu.al  treatment 
cncices  and  expected  outcomes,  to  establish  the  expected 
ireguency  of  variots  outcomes,  and  to  aerermine  wnat  outcome 
data  snould  be  collected. 

Tne  second  type  of  quality  control  appropriate  in  iaigt 
controlled  institutions  is  process  control.  As  disoussed 
earlier  in  this  paper,  ilAU  analysis  can  leal  to  process 
standards  for  a  number  of  symptom  complexes.  In  an 
institution  of  tnis  sort  process  control  can  ce  implemented 
tnrouga  reexamination  of  selected  patients,  by  patient 
interviews,  and  through  pa tient  record  audits.  Again  tne 
MAU  analysis  would  indicate  tne  data  that  should  be  captured 
cn  patient  records  in  order  to  maxe  the  audits  complete. 
Flagie^i,  in  discussing  process  standards,  suggests  nine 
criteria,  namely 

Measures  cr  inciusiveness; 

•picportion  of  the  population  reached, 
piopcrtion  of  health  problems  covered. 

Measures  of  content; 

ccmpleteness  of  services, 
rationality  of  services, 
responsiveness  of  services, 
numaaeness  of  services. 
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Measures  of  troductiviti’ ; 

vciufflG  cf  services  rendered, 
health  productivity,  and 
ccfcts  of  service. 

rnt  discussion  acove  directly  addresses  it^sues  in  tne  iteas 
cf  ccuipleteness  and  rationality  of  services,  but  the  MAO 
teconijues  cculd  just  as  easily  be  used  to  determine,  for 
exairple,  appropriate  levels  of  inclusi veness . 

Tne  third  level  of  control,  cased  on  structure 
measures,  can  be  applied  oy  ensuring’  tnat  the  capability  for 
gocd  quality  care  exists,  in  that  appropriate  eaUipoient  for 
the  desired  procedures  is  available  and  personnel  are  aale 
to  carry  cut  the  procedures.  MAU  analysis  can  both  indicate 
what  the  cptimal  procedures  are,  and  quantify  tue  degree  of 
quality  given  up  if  less  that  optimal  raciiities  are 
dva liable . 


Saall  Informal  Group  or  Private  Practice 

Problems  of  quality  control  in  this  setting  ace 
extremely  difficult,  as  indicated  by  the  literature  (c.f. 
Donabeaian  IS ^ 3^^  Fiagle^i).  Major  issues  are  the  lack  of 
objective,  ccciplete  data  on  patient  symptoms,  treatments, 
and  outcomes,  the  difficu.lcy  of  accessing  what  patient  data 
is  available,  the  lack  of  any  person  or  group  witn  the 
recognized  authority  to  make  quality  judgments  concerning 
private  practices,  and  a  long  tradition  against  meddling 
with  a  physician's  "private"  affairs.  It  would  clearly  be 
very  diificult  to  gather  outcome  data  ror  such  practices, 
but  one  might  reasonably  hope  to  utilize  some  types  of 
process  control.  It  seems  teasonaole,  fur  exaaple,  to 
contact  "patient  audits"  from  time  to  time.  A  sample  of 
patients,  either  chosen  randomly  or  seaected  oy  specific 
symptom  complexes,  could  re  interviewed,  and  tne 
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tcst-tredtinent  ri<=uuenoe  reco nstr ac a  tiirou^li  -'t 

records  arid  the  cecoilec  cions  ot  the  i-atic-.-.c  and  the 
pnysician.  Inis  or  course  tfould  require  a  onange  i.i: 
attitude  cn  the  part  of  many  physicidns.  Heasuies  cased  an 
structure  wculu  te  inuch  easier  to  construct  Mid  wouic  jiv* 
an  rndication  of  at  least  tne  tO’^‘=ntial  for  good  gualrtv 
care.  Certification  ana  recertification  exawinations  and 
continuing  ecucation  reguireinent s  can  De  ana  are  ueing  used 
to  insure  technical  competence,  wane  cnecKiists  of  required 
laroratory  facilities,  medical  instrums.i*a  t  ten,  e  x  ami  ration 
faciiities,  and  office  procedures  can  insure  an  adeguate 
pliysical  and  administrative  enviornment. 


Cer tiiication  ot  Quasi-Medical  InstituLj.or.^ 

There  is  currently  a  need  for  medical  cer tif icatior 
procedures  for  such  quasi-medical  institutions  aS  iiursing 
hemes,  rest  homes,  sanatoriums,  and  the  like.  In  cer.as  or 
ccntrolldoility,  such  institutions  fail  between  large  groups 
ana  private  practices.  The  right  or  an  authority,  usually 
the  state,  to  examine  and  question  medical  standards  is 
recognized,  tut  tne  direct  authority  evident  in,  say,  a 
military  medical  lacility  is  lacking.  In  these  situations, 
quality  standaids  based  on  structure  measures  are  certainly 
appropriate  ana  roasiole.  If  an  institution  requests 
certification  to  adm^it  and  treat  a  certain  type  of  patient, 
clearly  the  physical  faciiitic-s  and  medical  stair  required 
for  quality  treatment  would  have  to  be  available.  The  major 
questions  here  generally  pertain  to  the  degree  or  capaiility 
required.  Is  it  necessary  to  have  a  tail  time  paysician  in 
a  nursing  heue,  or  is  it  sufficient  to  have  cne  availaCie  on 
call?  i^eed  regular  physical  examinations  be  provided?  How 
often?  Is  a  nurse  aole  to  deliver  guaiity  caLs  in  thl^: 
setting,  or  a  physician's  assistant,  or  is  a  physician 
required?  iMAU  analysis  offers  the  capauisity  of  exaaining 
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any  number  of  sucn  -questions. 


Process  measures  can  be  made  wore  effective  in 
instituticnal  than  private  practices  since  tne  state  car. 
reasonaDly  impose  standards  of  patient  record  keeping,  and 
can  reserve  the  right  to  conduct  patient  audits  from  time  to 
time.  In  institutions  most  patients  are  p.rysicaliy  avaiiaoie 
for  extended  periods,  so  it  becomes  feasible  to  ccndact 
independent  medical  examinations.  Finally  the  extended 
nature  of  institutional  care  allows  for  the  gathering  of 
seme  outcome  data.  If  cure  rates,  length  of  stay,  or  ot.ier 
outcome  measures  for  a  particular  institution  are  abuertaai, 
a  mere  intensive  investigation,  such  as  a  patient  audit, 
could  be  condtetea. 
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